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PREFACE 



This study was conducted for the Naval Sea Systems Command's 
Cost Estimating and Analysis Division, Code 017. Funding was 
provided under the Naval Postgraduate Schools direct funding 
allotment, Project Code M4L1. 

This study represents a continuation of work initiated by 
Willis R. Greer and reported in "A Method For Estimating and 
Controlling the Cost of Extending Technology," Naval Postgraduate 
School Technical Report # NPS-54-88-002 , Monterey, CA. , March 1988. 
In that report, Greer: 

a) reviewed the literature on the measurement of the state 
of the art of technology, 

b) developed a methodology for measuring the advance in the 
state-of-the-art represented by a given development 
program, and 

c) established relationships between the advance in 
technology and development cost. 

Greer's research was conducted using a sample of 18 satellite 
systems . 

In a follow-on report, 0. Douglas Moses refined the analysis 
conducted by Greer by using an alternative methodology for 
measuring advances in the state-of-the-art of technology. That 
analysis was reported in "Estimating and Controlling the Cost of 
Extending Technology: A Revision and Extension", Naval Postgraduate 
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School Technical Report # NPS-54-89-06 , Monterey, CA. , March 1989. 

The objectives of the current study were, as stated in the 
proposal document: 

Determine whether an association between the degree to 
which a new system is technologically advanced with 
respect to it predecessors is an indication of the 
production costs that can be anticipated. If so, 

establish a reliable model depicting said association. 
Determine whether contractors exhibiting high-quality 
cost control can be distinguished from those who have 
been less successful in controlling costs. Perform such 
an analysis. Attempt to discover whether ex ante 
determinable characteristics are present in contractors 
which would allow predicting whether good or less- 
successful cost control can be expected. 

This final report is submitted in fulfillment of the agreement. 

The report is releasable. 

Although a continuation of prior research, this report is a 
self-contained document. Readers who are interested in a general 
review of studies addressing the measurement of technology are 
referred to the Greer report cited above. Readers who are 
interested in a summary of this current report are referred to 
Chapter VI. 
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I. 



INTRODUCTION 



When various components of the Department of Defense (DoD) 
enter into contractual agreements to procure newly-designed high- 
technology systems, particularly systems which extend the state- 
of-the-art of technology, there is considerable uncertainty 
concerning cost. In order to control the cost of acquisitions, it 
is important that DoD possess the ability to estimate the cost of 
producing such systems. 

Prior research has shown that useful measures of the state- 
of-the-art of technology embodied in various systems, and measures 
of the advance in technology from predecessor systems, can be 
created. Furthermore, these technology related measures have been 
shown to be useful in explaining the development cost associated 
with creating new systems. (See Greer, 1988, for a review.) The 
purpose of this study is to: 

a) determine if technology related measures are useful in 
explaining the production cost of high-technology systems 
and develop a cost prediction model using the technology 
measures, and 

b) determine if factors can be identified ex ante (prior to 
production) which are associated with cost overruns or 
cost savings (measured relative to expected production 
cost, predicted from the technology based model) . 

The analysis is conducted using data for a sample of military 
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aircraft produced during the 1950-1980 period. The organization 
of the remainder of the study is as follows: 

Chapter II describes the process used to select the sample of 
aircraft and the methodology used to create both technology related 
measures and measures of production cost. 

Chapter III provides an analysis for explaining production 
cost by technology measures. Regression procedures are employed 
to construct a model. Measures of cost variances (cost overruns 
or cost savings) are created by comparing actual production costs 
with predicted production costs. 

Chapter IV hypothesizes that cost variances are associated 
with factors reflecting characteristics of the aircraft procurement 
program and economic and political conditions existing prior to the 
time of production. Findings from tests of the hypotheses are 
presented. 

Chapter V hypothesizes that cost variances are associated with 
financial characteristics of contractors. Relationships between 
cost variances and a set of financial ratios are described. 

Chapter VI provides a summary and conclusions. 
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II. SAMPLE AND MEASURES 



One objective of this study is to determine and model 
relationships between technology and production cost. This chapter 
outlines the approach used to create measures of the state-of-the- 
art of technology and extensions in technology, and measures of 
production cost, to be used in later analysis. The analysis is 
conducted using a sample of aircraft as representative of high- 
technology systems. Since the measures created are related to the 
sample, this chapter starts with a discussion of the sample. 

SAMPLE 

The population for this study was originally defined as U.S. 
Military aircraft. The sample represents a subset of military 
aircraft for reasons set out below. The source of data was the 
U.S. Military Aircraft Cost Handbook [DePuy, et. al . , 1983], 
produced under contract to the Department of Defense, which 
contains a wealth of performance and cost data on military aircraft 
manufactured from the early 1950's through the early 1980's. 

The handbook contains data for 108 distinct individual 
aircraft, identified by mission (fighter, attack, patrol, bomber 
etc.), design and series. For example, the B-52C is a bomber (B) , 
design (52), third series (C) . Where successive series of a 
particular design resulted in virtually indistinguishable aircraft, 
the handbook combines series into a single program (e.g., A-7A, A- 
7B — >A-7A/B) . This reduced the number of distinct aircraft 
programs to 80. Since the study is concerned with the state of 
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technology represented by high-technology systems, as reflected in 
performance and capability (to be discussed in a later section) , 
it was necessary to reduce the sample further. The methodology for 
assigning a performance measure to aircraft relies on a baseline 
aircraft, the F-4B, which is used in both fighter and attack 
missions. Aircraft designed for other missions (strategic bombers 
and patrol) were deleted (n=19) . In addition, because the baseline 
F-4B is a conventional take-of f-and-landing (CTOL) aircraft and 
performance is related to the take-of f-and-landing mode, vertical 
and short take-of f-and-landing aircraft were deleted (n=6) . 
Finally when successive series of a particular design had the same 
performance, it was assumed that no extension in technology had 
been achieved and the later series was deleted (n=8) . Thus the 
final sample consists of 47 distinct CTOL fighter and attack 
aircraft manufactured from the early 1950's through the early 
1980 's. Table 1 contains a list of the aircraft programs, the 
prime contractor and the first year of production. 

MEASURING THE STATE-OF-THE-ART OF TECHNOLOGY 

The literature on technology measurement offers various broad 
approaches to determining the state-of-the-art (SOA) of technology 
for a given set of related systems. 1 Each approach requires the 
knowledge of a number (n) of technology variables reflecting 



'see, for examples, Alexander and Nelson, 1973; Dodson and 
Graver, 1969; Dodson, 1985; Greer, 1988; Knight, 1985; Martino, 
1985. 
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TABLE 1 



SAMPLE 



OBS 


PROGRAM 


COMPANY 


1 


F-89C 


NR UP 


*> 


F-2C 


MCDN 


3 


F-9F/H 


GRUM 


A 


F-8AF 


REPB 


s 


F-86D 


NOAM 


6 


F-8 6F 


NOAM 


7 


F-89D 


NR UP 


8 


A-1E/G/H 


DOUG 


9 


F-1B/C/M 


NOAM 


10 


F-3A/B/C 


MCDN 


11 


F-8 6H 


NOAM 


12 


F-100A/C 


NOAM 


13 


A-3A/B 


DOUG 


1A 


A-AA/8 


MCDD 


15 


F-6A 


DOUG 


16 


F-11A 


GRUM 


17 


F-1C2A 


GDYN 


18 


F/AF-1E 


NOAM 


19 


F-100D 


NOAM 


20 


F-101A/8 


MCDD 


21 


A“ 1 J 


DOUG 


22 


F-8A/B/C 


VGHT 


23 


F-9J 


GRUM 


2A 


F-10AA/B 


LOCK 


25 


A-AC 


MCDD 


26 


F-10S8/D 


REPB 


27 


F-106A/B 


GDYN 


28 


f-aa/b 


MCDD 


29 


A-AE/F 


MCDD 


30 


A- 6 A 


GRUM 


31 


F-AC/D 


MCDD 


32 


A-7A/B 


VGHT 


33 


F-111A 


GDYN 


3A 


F-AE 


MCDD 


35 


F-AJ 


MCDD 


36 


F-111B 


GDYN 


37 


A-7D 


VGHT 


38 


A-7E 


VGHT 


39 


F-111D 


GDYN 


A0 


A-AM 


MCDD 


A 1 


A-6E 


GRUM 


A2 


F-111F 


GDYN 


A3 


F-1AA 


GRUM 


AA 


F-1SA 


MCDD 


AS 


A-10A 


FAIR 


A6 


F-16A 


GDYN 


A 7 


F/A-18A 


MCDD 



NOTATION: 

DOUG=DOUGLAS 

MCDD = MCDONALD DOUGLAS 

GRUM*GR UNMAN 

VGHT sVOUGHT 

FA1R*FA1R CHILD 

NOAMsNORTH AMERICAN 

MCDN= MCDONALD 

GDYN=GENERAL DYNAMICS 

REPBsREPUBLIC 

NR UP* NOR THR UP 

LOCK=LOCKHEED 



YEAR 

SO 

SI 

SI 

SI 

51 

51 

SI 

S2 

s: 

sc 

52 

52 

S3 

S3 

S3 

S3 

S3 

5A 

SA 

SA 

ss 

ss 

ss 

56 

S 7 

57 

S7 

S9 

61 

61 

62 

65 

65 

66 

66 

66 

68 

68 

68 

70 

70 

7 C 

71 

73 

75 

78 

79 
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distinct properties or characteristics. Each approach combines the 
variables into a single SOA measure which has a scale independent 
of the scales of the individual technology characteristics (which 
are typically measured in differing types of units) . The 
judgmental weighing approach [Gordon and Munson, 1981] express SOA 
as a direct combination of values of the technology 

characteristics. Gordon and Munson suggest two general forms of 

SOA equations. 

SOA = BjVj + B 2 V 2 + B m V n 

and 

SOA = Vj[B 2 V 2 + B 3 V 3 + B n VJ 

where 

B 1 = judgmentally assigned weights 

V 1 = the value of the ith technology describing variable. 

The first version of the model is a simple linear combination 
of weighted characteristics, the second version is a multiplicative 
form intended for use when one variable (Vj) must be present in the 
system. 

The measures used to reflect technology in this study were 
constructed by The Analytic Sciences Corporation [Timperlake, et. 
al., 1980] and rely on the judgmental weighing approach. They 
determined two "figures of merit" for each aircraft. The airframe 
performance (AP) score reflects the performance and capability of 
the airframe and engine. The aircraft system performance (ASP) 
score reflects the capability of the airframe, engine and the 
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electronics, navigation and weapons systems, i.e., the complete 
aircraft. Each score is a judgmentally weighted function of more 
basic properties. 

Airframe performance is measured by 

AP = Bj x P + B 2 x R + B 3 x M + B 4 x V 

where 

Bj = Judgmental weights 
P = Payload 

R = Range and basing mode 
M = Maneuverability 
V = Useful speed 

This formulation is an additive multi-attribute utility function 
[Keeney and Raiffa, 1976]. Because values of P, R, M, and V are 
expressed in different units, values for P, R, M and V for 
individual aircraft were divided by the corresponding values for 
the baseline F-4B aircraft. This results in all characteristics 
being expressed as ratios, which can be combined into an overall 
score . 

Weights were determined by the consensus judgment of a large 
panel of expert operational personnel. Weights were assigned such 
that the baseline F-4B had an AP score of 10. 

Aircraft system performance is measured by 

ASP = S (B 1 xPxU + B 2 xRxN + B 3 xM+B 4 xV) 

where 

S = Survivability modifier, reflecting susceptibility 
to detection, identification and destruction. 
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U = Payload utility modifier, reflecting target 
acquisition and target engagement capability. 

N = Navigation coefficient, reflecting internal 
navigation system capability. 

= as previously defined. 

Again, values of individual characteristics were scaled by the 
value for the baseline F-4B aircraft, and expert judgment was 
relied on for determining the functional form and weights of the 
utility function. 

Note that the individual properties reflected in the models 
represents "output" measures of performance or capability along 
distinct dimensions. This is consistent with the work of Knight 
[1985] who distinguishes between structural and functional 
technology measures. Structural measures capture physical 

characteristics, i.e., "what the system looks like". Functional 
measures capture capabilities, i.e., "what the system does". 
Measures of function or output can be used to compare systems of 
differing structure. 

These two measures were taken as summary indicators of the SOA 
of technology embodied in the aircraft, reflecting their functional 
capability. Three technology SOA measures to be used in later 
analysis were defined as follows: 

1. Plat form (Airframe and Engine) Tech nology (PLATTECH) = AP. 

2. Fly away Aircraft System Tech nology (FLYTECH) = ASP 

3. Weapons and Avionics Sys tem Tech nology (SYSTECH) = ASP/AP. 
The SYSTECH measure is derived from the two others and is a rough 
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attempt to capture the degree to which the technology in weapons 
systems and avionics systems enhances airframe and engine 
capability to achieve flyaway aircraft system capability. 2 

When speaking of the three technology measures collectively, 
the expression "TECH" will be used. Values of the TECH measures 
for the sample are in Table 2. 



MEASURING EXTENSIONS OF TECHNOLOGY 

Various researchers have developed methods for measuring 
extensions in technology (see Dodson, 1985; Greer, 1988, for 
reviews) . One common approach relies on the idea of the "year-of- 
technology" [Alexander and Nelson, 1972; Greer and Moses, 1989]. 
In this approach, time is related to technology measures in a 

multiple regression: 

Y = a + bjXj + b 2 X 2 + ... + b n X n + e 

where 

Y = actual year the system become operational. 
b i = regression coefficients 

X i = technology measures 
e = residual 

A predicted value from the regression equation for an individual 
system represents the "year-of-technology" for that system. If 
the actual year a given system was produced is less than its year- 
of-technology, it can be said that the system was produced "ahead 
of its time" and represents an advancement in technology. 

2 Dividing ASP by AP is consistent with the idea that the 
components in the AP formula have been multiplied by modifiers to 
arrive at ASP. 
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TABLE 2 



INITIAL TECHNOLOGY MEASURES 



08$ 


PROGRAM 


PLATTECH 


SYSTECH 


FLYTECH 


1 


A-1J 


6.57 


0.50837 


3.34 


2 


A-1E/G/H 


6.57 


0.50837 


3.34 


3 


A-3A/8 


12.84 


0.83645 


10.74 


4 


A-4C 


6.22 


0.87621 


5.45 


5 


A-4M 


7.33 


1.16235 


8.52 


6 


A-4A/8 


6.84 


0.57456 


3.93 


7 


A-4E/F 


7.22 


1.00693 


7.27 


8 


A- 6 A 


12.13 


1.14015 


13.83 


9 


A-6E 


12.13 


1.84666 


22.40 


10 


A-7D 


10.73 


1.50699 


16.17 


11 


A-7E 


11.59 


1.70578 


19.77 


12 


A-7A/B 


11.57 


1.04581 


12.10 


13 


A-10A 


11.03 


1.09882 


12.12 


14 


F- 1 8/C/M 


5.90 


0.89661 


5.29 


15 


F/AF-1E 


6.05 


0.89917 


5.44 


16 


F-2C 


6.13 


0.63785 


3.91 


17 


F-3A/B/C 


7.30 


1.23562 


9.02 


18 


F-4E 


10.17 


1.57266 


13.96 


19 


F-4J 


10.31 


1.29874 


13.39 


20 


F-4A/8 


10.31 


0.90398 


9.32 


21 


F-4C/D 


10.00 


1.00700 


10.07 


22 


F-6A 


7.60 


0.99737 


7.58 


23 


F-8A/B/C 


8.40 


1.00000 


8.40 


26 


F-9J 


4,72 


0.85169 


4.02 


25 


F-9F/H 


5.00 


0.85800 


4.19 


26 


F-11A 


6.35 


0.91339 


5.80 


27 


F-14A 


14.44 


2.18213 


31.51 


00 

rj 


F-15A 


12.11 


1.33278 


16.14 


29 


F-16A 


11.56 


1.35727 


15.69 


30 


F/A-18 A 


11.60 


2.19138 


25.42 


31 


F-84F 


7.85 


0.65350 


5.13 


32 


F-86D 


5.31 


0.69303 


3.68 


33 


F-86F 


5.09 


0.79175 


4.03 


34 


F-86H 


6.08 


0.93421 


5.68 


35 


F-89C 


3.72 


0.66129 


2.46 


36 


F-89D 


4.72 


0.85805 


4.05 


37 


F-100D 


6.25 


0.95840 


5.99 


38 


F-100A/C 


5.51 


0.87114 


4.80 


39 


F- 1 0 1 A/8 


9.69 


1.37771 


13.35 


40 


F-102A 


8 .02 


1.21072 


9.71 


41 


F-104A/B 


6.64 


1.02259 


6.79 


42 


F- 1 058/D 


11.68 


1.27226 


14.86 


43 


F-106A/B 


9.58 


1.36221 


13.05 


44 


F-111A 


15.45 


1 .19482 


18.46 


45 


F-1118 


16.48 


1.50546 


24.81 


46 


F-111D 


16.48 


1.47998 


24.39 


47 


F-111F 


16.48 


1.88167 


31.01 
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As simplistic as this method seems, related work by Lienhard 
[1979] tends to support the concept. His paper studied the rate 
at which technology is improved, and how (whether) this rate 
changes through time. He studied several forms of technology 
(clocks, steam power, land transportation, low temperatures, air 
transportation) over extended time periods. The most relevant 
observation to come from Lienhard' s study was that the rate of 
improvement of a particular technology, once established, does not 
change. If this is correct, there could be some major implications 
for the cost, and even the feasibility, of attempting to effect 
technological advances "before their time". If a desired advance 
could normally be expected to occur only by some quasi-naturally 
established date, attempts to accelerate this process would be very 
costly. Accordingly, the year-of-technology approach may be well 
reasoned. 

The essence of the year-of-technology approach is to relate 
technology to time and use deviations from the time line as 
indicators of the technology advancement represented by individual 
systems. A similar approach is used here, but TECH is treated as 
the dependent variable rather than time. (Since summary technology 
variables are used, rather than many technology characteristics, 
they can be used as the dependent variable with results that are 
equivalent but easier to display and discuss.) 

Results of separately regressing the three TECH variables 
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against the year in which the aircraft were first operational 
(YEAR) are shown in Table 3. Not surprisingly, in each case 
coefficients for YEAR are positive and significant, indicating that 
technology increases with time. The relatively high R 2 values 
indicate that time explains a large proportion of the technology 
variance among the aircraft. 

Plots of the three TECH measures over time are displayed in 
Figures 1, 2, and 3. The A-6E is circled in the figures. 
Observing Figure 1, we can see that the A-6E falls approximately 
on the trend line. The technology embodied in the A-6E platform 
was not in excess of the average state-of-the-art of platform 
technology at the time of the A-6E's production. Figure 2 shows 
that the weapons and avionic systems in the A-6E were advanced 
relative to the average state of systems technology. The result 
(Figure 3) was a flyaway aircraft also advanced relative to the 
average trend in aircraft technology at the time of the A-6E's 
production. 

These observations can be generalized to define three 
variables reflecting technological complexity or extension: 

1. STAND: the average state of the art of technology at the 
time of production of a system. (For any individual aircraft this 
is the predicted value from the trend line.) 

2. ADVANCE: the extension in technology beyond the state of 
the art. (For any individual aircraft, this is the residual from 
the regression model, or the deviation from the trend line.) 
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TABLE 3 



REGRESSION OF TECH ON YEAR 



Dependent Variable 

Independent Variable 

Intercept 
YEAR Coefficient 
Coefficient t 
Significance 

Model F 

Model Significance 
R 2 

Adjusted R 2 



PLATTECH 


SYSTECH 


YEAR 


YEAR 


-8.619 


-1.038 


.2971 


. 0362 


7 . Oil 


7.902 


.0001 


.0001 


49.16 


62.44 


.0001 


. 0001 


.5221 


.5812 


.5115 


.5719 



FLYTECH 

YEAR 

-30.943 

.7063 

8.386 

.0001 

70.32 
.0001 
. 6098 
.6011 
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FIGURE 1 



PLOT OF PLATFORM TECHNOLOGY OVER TIME 
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FIGURE 2 

PLOT OF SYSTEM TECHNOLOGY OVER TIME 
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3. REACH: the total technology embodied in the system. (For 
any individual system this is simply STAND + ADVANCE.) 3 

Table 4 contains values of STAND, ADVANCE and REACH for the 
sample for the three kinds of technology, PLATTECH, SYSTECH, 
FLYTECH, denoted with prefixes P,S and F, respectively. 

THE MEASUREMENT OF PRODUCTION COST 

All cost data for the aircraft were taken from the US Military 
Aircraft Cost Handbook (Depuy, et. .al., 1983). This section 

describes the steps taken to arrive at a production cost figure for 
each aircraft that could be considered comparable across the 
sample. Determination of comparable cost figures were hampered by 
three factors: 

A. Costs were incurred at different points in time when the 
value of the dollar differed. 

B. Aircraft were not purchased singly, but rather in "lots" 
of varying quantity. 

C. Cost per unit tends to decline with additional units 
produced due to production "learning". 



3 Note, there are alternative ways of determining measures of 
STAND and ADVANCE. Rather than using a trend line to reflect the 
average state-of-the-art of technology, one could designate a 
specific individual system as a reference point. Candidates might 
be a) an immediate predecessor system or b) the predecessor system 
with the greatest REACH (maximum predecessor technology) . The 
technology embodied in either reference system would constitute 
STAND, and ADVANCE would be measured as deviations from the 
specific reference system. (Of course the reference system would 
change as time progressed.) These alternatives were explored with 
no material enhancement of the analysis. 
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TABLE 4 



MEASURES OF STAND, ADVANCE AND REACH 



OBS 


PROGRAM 


PSTAND 


padvance 


PREACH 


SSTAND 


SADVANCE 


SREACH 


FSTAND 


F ADVANCE 


FREACH 


1 


A-1J 


7.7244 


-1.1544 


6.57 


0.95367 


-0.44530 


0.50837 


7.9013 


-4.5613 


3.34 


■> 


A-1E/G/H 


6.8329 


-0.2629 


6.57 


0.84505 


-0.33668 


0.50837 


5.7825 


-2.4425 


3.34 


3 


A-3A/B 


7.1301 


5.7099 


12.84 


0 .88126 


-0.04481 


0.83645 


6.4887 


4.2513 


10.74 


4 


A-4C 


8.3188 


-2.0988 


6.22 


1.02608 


-0.14987 


0.87621 


9.3138 


-3.8638 


5.45 


5 


A-4M 


12.1819 


-4.8519 


7.33 


1 .49676 


-0.33441 


1.16235 


18.4951 


-9.9751 


8.52 


6 


A-4A/8 


7.1301 


-0.2901 


6.84 


0.88126 


-0.30670 


0.57456 


6.4887 


-2.5587 


3.93 


7 


A-4E/F 


9.5074 


-2.2874 


7.22 


1.17090 


-0.16398 


1.00693 


12.1388 


-4.8688 


7.27 


8 


A- 6 A 


9.5074 


2.6226 


12.13 


1.17090 


-0.03076 


1.14015 


12. 1388 


1.6912 


13.83 


9 


A-6E 


12.1819 


-0.0519 


12.13 


1 .49676 


0.34990 


1 .84666 


18.4951 


3.9049 


22.40 


10 


A-7D 


11.5876 


-0.8576 


10.73 


1 .42435 


0.08264 


1.50699 


17.0826 


-0.9126 


16.17 


1 1 


A-7E 


11.5876 


0.0024 


11.59 


1.42435 


0.28143 


1.70578 


17.0826 


2.6874 


19.77 


12 


A-7A/B 


10.6961 


0.8739 


11.57 


1.31573 


-0.26992 


1 .04581 


14.9639 


-2.8639 


12. 1C 


13 


A-10A 


13.6677 


-2.6377 


1 1.03 


1.67779 


-0.57897 


1.09882 


22.0264 


-9.9064 


12.12 


14 


F-18/C/M 


6.8329 


-0.9329 


5.90 


0.84505 


0.05156 


0.89661 


5.7825 


-0.4925 


5.29 


IS 


F/AF-1E 


7.4273 


-1.3773 


6.05 


0.91746 


-0.01829 


0.89917 


7.1950 


-1.7550 


5.44 


16 


F-2C 


6.5358 


-0.4058 


6.13 


0.80885 


-0.17100 


0.63785 


5.0762 


-1.1662 


3.91 


17 


F-3A/3/C 


6.8329 


0.4671 


7.30 


0.84505 


0.39057 


1.23562 


5.7825 


3.2375 


9.02 


18 


F-4E 


1 0 .9932 


-0.8232 


10.17 


1.35193 


0.02073 


1.37266 


15.6701 


-1.7101 


13.96 


19 


F-4J 


10.9932 


-0.6832 


10.31 


1.35193 


-0.05319 


1 .29874 


15.6701 


-2.2801 


13.39 


20 


F-4A/B 


8.9131 


1.3969 


10.31 


1.09849 


-0.19452 


0.90398 


10.7263 


-1.4063 


9.32 


21 


F-4C/D 


9. 8046 


0.1954 


10.00 


1.20711 


-0.20011 


1.00700 


12.8451 


-2.7751 


10.07 


22 


F-6A 


7.1301 


0.4699 


7.60 


0.88126 


0.11611 


0.99737 


6.4887 


1.0913 


7.58 


23 


F-8A/8/C 


7.7244 


0.6756 


8.40 


0.95367 


0.04633 


1.00000 


7.9013 


0.4987 


8.40 


24 


F-9J 


7.7244 


-3.0044 


4.72 


0.95367 


-0.10197 


0.85169 


7.9013 


-3.8813 


4.02 


25 


F-9F/H 


6.5358 


-1.5358 


5.00 


0.80885 


0.02915 


0.83800 


5.0762 


-0.8862 


4.19 


26 


F-11A 


7.1301 


-0.7801 


6.35 


0.88126 


0.03213 


0.91339 


6.4887 


-0.6887 


5.80 


27 


F— 1 4 A 


12.4790 


1.9610 


14 .44 


1.53296 


0.64917 


2.18213 


19.2014 


12.3086 


31.51 


28 


F-15A 


13.C734 


-0.9634 


12.11 


1.60538 


-0.27259 


1.33278 


20.6139 


-4.4739 


16.14 


29 


F-16A 


14.5592 


-2.9992 


11.56 


1.78641 


-0.42914 


1.35727 


24.1452 


-8.4552 


15.69 


30 


F/A-18A 


14 .8564 


-3.2564 


11.60 


1 .82261 


0.36877 


2.19138 


24.8515 


0.5685 


25.42 


31 


F-84F 


6.5358 


1.3142 


7.85 


0.80885 


-0.15534 


0.65350 


5.0762 


0.0538 


5.13 


32 


F-8 6D 


6.5358 


-1.2258 


5.31 


0.80885 


-0.11581 


0.69303 


5.0762 


-1.3962 


3.68 


33 


F-86 = 


6.5358 


-1.4458 


5.09 


0.80885 


-0.01710 


0.79175 


5.0762 


-1 .0462 


4.03 


34 


F-8 6H 


6.8329 


-0.7529 


6.08 


0.84505 


0.08916 


0.93421 


5.7825 


-0.1025 


5.68 


35 


F-89C 


6.2 38 6 


-2.5186 


3.72 


0.77264 


-0.11135 


0.66129 


4.3700 


-1.9100 


2.46 


36 


F-89D 


6.5358 


-1 .8158 


4.72 


0.80885 


0.04921 


0.85805 


5.0762 


-1.0262 


4.05 


37 


F-100D 


7.4273 


-1.1773 


6.25 


0.91746 


0.04094 


0.95840 


7.1950 


-1.2050 


5.99 


38 


F-100A/C 


6.8329 


-1.3229 


5.51 


0.84505 


0.02609 


0.87114 


5.7825 


-0.9825 


4 .80 


39 


F-101A/8 


7.4273 


2.2627 


9.69 


0.91746 


0.46025 


1.37771 


7.1950 


6.1550 


13.35 


40 


F-102A 


7.1301 


0.8899 


8.02 


0.88126 


0.32947 


1.21072 


6 .4887 


3.2213 


9.71 


41 


F- 1 04 A/8 


8.0216 


-1.3816 


6.64 


0.98987 


0.03272 


1.02259 


8.6075 


-1.8175 


6.79 


42 


F- 1058/D 


8.3188 


3.3612 


11.68 


1.02608 


0.24618 


1.27226 


9.3138 


5.5462 


14.86 


43 


F-106A/B 


8.3188 


1 .2612 


9.58 


1.02608 


0.33613 


1.36221 


9.3138 


3.7362 


13.05 


44 


F-111A 


10.6961 


4.7539 


15.45 


1.31573 


-0.12091 


1 .19482 


14.9639 


3.4961 


18.46 


45 


F-111B 


10.9932 


5.4868 


16.48 


1.35193 


0.15353 


1.50546 


15.6701 


9.1399 


24.81 


46 


F-111D 


11.5876 


4 .8924 


16.48 


1.42435 


0.05563 


1.47998 


17.0826 


7.3074 


24.39 


47 


F-111F 


12.1819 


4.2931 


16.48 


1.49676 


0.38492 


1.88167 


18.4951 


12.5149 


31.01 
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The raw data available consisted of costs and quantities per 
lot. The following procedures were employed to transform the 
available data into comparable cost figures. 

1. All lot costs were converted to fiscal year 1981 dollars 
using Office of Assistant Secretary of Defense, Comptroller, 
composite price indices for major commodity procurement. 

2. Cumulative quantities at the end of each lot were 
determined by summing the quantities in all preceding lots. 

3. Cumulative average costs (FY81) at the end of each lot 
were determined by summing the costs of all preceding lots and 
dividing by the cumulative quantities. 

4. Learning curves of the following form were fit to the 
quantity and cumulative average cost series: 

C Q = aq b 

where 

C Q = Cumulative average cost for quantity Q 

Q = Cumulative quantity 

A = Cost of the first unit 

(estimated by the fitting procedure) 

B = Constant, estimated by the fitting procedure. 

5. The cumulative average cost of producing 100 
units, CAC(lOO), was determined by setting Q at 100 and re- 
entering the learning curve to solve for Cg. 

This procedure is ad hoc but does provide a comparable average 
cost figure at a comparable quantity for all aircraft, taking into 
consideration the different learning rates experienced on different 
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aircraft programs. The result is an average cost per unit of 
producing 100 aircraft. 4 

Cost data was available for three separate cost categories for 

each aircraft: 

Airframe cost 

Airframe plus engine cost 

Total flyaway cost 

The approach described above was applied to the three separate cost 
categories resulting in three variables to be used in the analysis: 

FRAMCOST: CAC(IOO) for air fram e cost. 

PLATCOST: CAC (100) for aircraft plat form (airframe & 

engine) cost. 

FLYCOST: CAC(IOO) for fly away aircraft cost. 

Note that there is a direct correspondence between PLATCOST and the 
previously discussed PLATT ECH measure, and between FLYCOST and 
FLYTECH. In these cases, the TECH variables measure technology and 
the COST variables measure cost for analogously defined components 
of the aircraft. FRAMCOST is a cost measure for airframes, but 
there are no corresponding TECH measures. (Without an engine the 
aircraft can't fly, so no separate measure of airframe performance 
or technology is possible.) Technology measures for platforms 
will be used when attempting to explain airframe costs. 
Additionally, there are TECH measures for systems but no analogous 
cost measure. Technology measures for systems will be used in 



4 

For discussions of learning curves and their relationship to 
production cost see Kaplan [1982], Liao [1989] and Womer [1979]. 
For more detail on the specific procedures used to determine CAC 
see DePuy , et. al. [1983]. The convention of determining CAC at 
100 units has been adopted by other researchers. See, for example, 
Dodson [1977]. 
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some of the tests explaining FLYCOST, since the cost of avionics 
and weapons systems are included in the total flyaway cost. 

Table 5 contains the COST measures for the aircraft in the 
sample (measured in millions of FY81 dollars) . Missing historical 
data for some of the sample aircraft resulted in missing COST 
measures. Those aircraft were delete from further analysis. Table 
5 also contains a SERIES variable, to be discussed in the next 
chapter. 
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TABLE 5 



UNIT PRODUCTION COST MEASURES 



OBS 


PROGRAM 


FRAMCOST 


PLATCOST 


FLYCOST 


SCRIES 


1 


A- 1 J 


, 




. 


. 


2 


A- 1E/G/H 


1.212 


1.557 


1.703 


0 


3 


A-5A/B 


5.156 


6.007 


7.815 


1 


4 


A- 4 C 


1.669 


1 .895 


2.100 


0 


5 


A-4M 


2.225 


2.927 


5.714 


0 


6 


A-4A/B 


1.605 


1 .859 


1.917 


1 


7 


A-4E/F 


1.875 


2.436 


2.675 


0 


8 


A-6A 


11.286 


12.421 


15.123 


1 


9 


A-6E 


7.656 


8 .883 


10.846 


0 


10 


A-7D 


2.950 


5.847 


5.012 


0 


1 1 


A-7E 


5.901 


4.855 


5.000 


0 


12 


A-7A/8 


5.217 


4.511 


5.272 


1 


IS 


A-10A 


4.196 


5.748 


7.272 


1 


14 


F-1B/C/M 


2.229 


2.297 


2.388 


1 


15 


f/af-ie 










16 


F-2C 










17 


F-5A/B/C 


5.419 


4.205 


4.710 


1 


18 


F-4E 


5.649 


4.479 


5.919 


0 


19 


F-4J 


5.511 


4.416 


5.924 


0 


20 


F-4A/B 


7.202 


8.802 


9.613 


1 


21 


F-4C/D 






5.753 


0 


22 


F-6A 










25 


F-8A/B/C 


5.746 


4.334 


4.475 


1 


24 


F-9J 










25 


F-9F/H 


0.655 


0.856 


0.939 


1 


26 


F-11A 










27 


F- 1 4 A 


13.082 


17.535 


25.901 


1 


28 


F-15A 


10.252 


15.446 


19.356 


1 


29 


F-16A 


4.045 


6.069 


9.641 


1 


50 


F/A-18A 


18 .854 


22.197 


25.968 


1 


51 


F-84F 


6.520 


6.020 


5.94 3 


0 


52 


F-86D 


0.752 


1.118 


1.458 


0 


55 


F-86F 


0.887 


1.028 


1.095 


0 


54 


F-86H 






. 


. 


55 


F-S9C 








. 


56 


F-89D 


2.471 


2.831 


3.496 


0 


57 


F-100D 


1.6 98 


2.426 


2.659 


0 


58 


F-100A/C 


2.939 


5.709 


3.856 


1 


59 


F-101A/B 


5.771 


6.755 


7.291 


1 


40 


F-102A 


6.802 


8.125 


9.206 


1 


41 


F-104A/B 


2.004 


3.850 


3.775 


1 


42 


F- 1058/D 


10.047 


10.952 


12.280 


1 


45 


F-106A/8 


7.014 


7.897 


12.016 


1 


44 


F-111A 


. 




23.510 


1 


45 


F-1118 










46 


F-111D 




. 


24.141 


0 


47 


F-111F 


9.827 


14.121 


20.897 


0 
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III. PRODUCTION COST AND TECHNOLOGY 



HYPOTHESES AND TESTS 

The initial analysis concerns the association between 
production cost and the SOA of technology in the aircraft produced. 
Can technology measures reliably predict production cost? The 
first hypothesis is that production cost increases with increases 
in the SOA of technology (the level of technological complexity) . 
STAND reflects the average SOA of technology at the time of the 
commencement of production of an aircraft. 

H 1 : Production Cost = + f (STAND) 

The second hypothesis is that production cost increases with 
the degree of technological extension of a program. ADVANCE 
captures this notion. 5 

H 2 : Production Cost = + f (ADVANCE) 

The third hypothesis follows from the mixed nature of the 
sample. The sample includes some aircraft which are the first 
series of a new design (eg. F-111A) and some which are follow-on 
series of an existing design (e.g. F-111B, F-111D, F-111F) . It is 
reasonable to argue that sufficient production learning would occur 
during the first series of new design so that follow-on series 
would experience some reduction in cost. Hence 

H 3 : Production Cost = + f (first series of new design) 



5 REACH is a linear combination of STAND and ADVANCE and, 
hence, redundant for testing purposes; it contains no additional 
information. 
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A dummy variable (SERIES) was created to capture this idea. SERIES 
was coded 1 for the first series of a new design and 0 for a 
follow-on series of an existing design. 

Operationally, the hypotheses imply the following multiple 
regressions: 

FRAMCOST = + f (PSTAND, PADVANCE, SERIES) 

PLATCOST = + f (PSTAND, PADVANCE, SERIES) 

FLYCOST = + f (FSTAND, FADVANCE, SERIES) 

Following the recommendations of others (e.g. DePuy, et. al., 
1980) , regressions using both COST and In (COST) measures as 
dependant variables were run. Using the natural log reduces the 
effect of extremes on the regression (particularly important when 
sample size is small) . Additionally, regressions using COST as the 
dependant variable were found to be heteroscedatic (larger 
residuals at larger values of cost) . This violates an assumption 
of regression that error variance is constant over all 
observations, resulting in residuals that are not of minimum 
variance. A common solution to this problem is to log the 
dependant variable (see Neter and Wasserman, 1974) . Findings from 
using the two alternative measures were similar, but the use of 
ln(COST) , produced higher R 2 values. Those results (Models 1-3) 
are in Table 6. 

All models in Table 6 are highly significant and explain a 
large proportion of the variance in production cost. All 
coefficients for the STAND, ADVANCE and SERIES predictors are also 
significant and positive, consistent with the hypotheses. The 
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TABLE 6 



COST REGRESSIONS - ALL AIRCRAFT 



Model 


Dependent Independent 
Variable Variables 


Coef f . 


t 


Prob. * 


Model 

Statistics 


1 


FRAMCOST 


Intercept 


-792 


— 


— 


F = 21.30 






PSTAND 


• 206 


6.17 


.0001 


Prob. = .0001 






PADVANCE 


.212 


5.11 


.0001 


R 2 = .67 






SERIES 


.363 


2.07 


.0233 


Adj. R 2 = .64 


2 


PLATCOST 


Intercept 


-.706 


— 


— 


F = 27.71 






PSTAND 


.219 


7.36 


. 0001 


Prob. = .0001 






PADVANCE 


. 198 


5.35 


.0001 


R 2 = .73 






SERIES 


.388 


2.48 


.0094 


Adj . R 2 = .70 


3 


FLYCOST 


Intercept 


.321 


— 


— 


F = 34.19- 






FSTAND 


. 099 


7.95 


.0001 


Prob. = .0001 






FADVANCE 


.092 


5.97 


.0001 


R 2 = .75 






SERIES 


.446 


2.96 


.0028 


Adj. R 2 = .73 


4 


FLYCOST 


Intercept 


.312 


— 


— 


F = 39.94 






FSTAND 


.104 


9.84 


.0001 


Prob. = .0001 






PADVANCE 


.189 


6.48 


.0001 


R 2 = .83 






SADVANCE 


. 589 


2.36 


.0122 


Adj . R 2 = .81 






SERIES 


.329 


2.55 


.0078 





* One tailed tests 
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conclusion is that both the SOA of technology in general and the 
extension of technology in individual aircraft explain production 
cost. And the findings for the SERIES variable indicate an 
important "premium" in production cost for new designs. 

Note that Model 2 explains a greater proportion of PLATCOST 
than Model 1 does for FRAMCOST. Since the two models contain the 
same predictor variables, this result is consistent with PSTAND 
and PADVANCE being surrogates for frame technology and measuring 
technology SOA and extension for airframes with "noise". 

Model 4 in table 6 is an alternative approach to explaining 
FLYCOST by using the separate ADVANCE measures for platform and 

c 

systems, the two items making up the flyaway aircraft. The basic 
conclusion to be drawn from model 4 is that additional explanatory 
ability is achieved by substituting PADVANCE and SADVANCE for 
FAD VANCE . 7 

Tables 7 and 8 display analogous regressions for two 
subsamples: new design, first series and old design, follow-on 
series, respectively. In general, the findings are consistent with 
those from the full sample: R 2 s are high and coefficients are 

positive and significant. Model and coefficient significance 



g 

All STAND measures, being predicted values from a regression 
of TECH on time, are linear transformation of each other. Hence 
FSTAND is included in Model 4 

7 Each model was also run using REACH in place of STAND and 
ADVANCE. R s decreased, but all regressions were highly 
significant, indicating that a measure reflecting total technology 
in systems does well as a substitute for the two separate measures 
reflecting technology trend plus extension. 
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TABLE 7 



COST REGRESSIONS - NEW DESIGN / FIRST SERIES 



Model 


Dependent Independent 
Variable Variables 


Coef f . 


t 


Prob.* 


Model 

Statistics 


1 


FRAMCOST Intercept 


-.647 


— 


— 


F = 12.90 




PSTAND 


.228 


4.72 


.0001 


Prob. = .0004 




PADVANCE 


.228 


3.78 


.0008 


R 2 = .60 
Adj. R 2 = .57 



2 


PLATCOST 


Intercept 

PSTAND 

PADVANCE 


-.509 

.239 

.207 


5.34 

3.70 


. 0001 
.0009 


F = 15.33 
Prob. = .0002 
R 2 = .64 
Adj . R 2 = .60 


3 


FLYCOST 


Intercept 


.654 


— 


— 


F ='21.87 
* 






FSTAND 


.108 


6.17 


.0001 


• 

Prob. = .0001 






FADVANCE 


.101 


4.31 


.0002 


R 2 = .71 














Adj . R 2 =• .68 


4 


FLYCOST 


Intercept 


.426 


— 


— 


F = 27.48 






FSTAND 


.121 


8.45 


.0001 


Prob. = .0001 






PADVANCE 


. 198 


5.08 


.0001 


R 2 = .83 






SADVANCE 


.874 


3.02 


.0039 


Adj . R 2 = .80 



* One tailed tests 
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TABLE 8 



COST REGRESSIONS - OLD DESIGN / NEW SERIES 



Model 


Dependent 

Variable 


Independent 

Variables 


Coef f . 


t 


Prob. * 


Model 

Statistics 


1 


FRAMCOST 


Intercept 


-.499 


— 


— 


F = 12.64 






PSTAND 


.174 


3.40 


. 0027 


Prob. = .0011 






PADVANCE 


.209 


3.31 


. 0031 


R 2 = .68 














Adj . R 2 = .62 


2 


PLATCOST 


Intercept 


-.398 




— 


F = 19.93 






PSTAND 


.186 


4 .44 


.0004 


Prob. = .0002 






PADVANCE 


.206 


3.98 


.0009 


R 2 = .77 














Adj . R 2 = .73 


3 


FLYCOST 


Intercept 


.466 


— 


— 


F = 23.14 






FSTAND 


.087 


4.20 


.0005 


Prob . „ = .0001 
* 






FADVANCE 


.091 


3.93 


.0008 


R 2 = .77 



Adj. R 2 = .73 



4 


FLYCOST 


Intercept 


.495 


— 


— 


F = 24.86 






PSTAND 


.089 


4.83 


.0002 


Prob. = .0001 






PADVANCE 


.222 


4.82 


. 0002 


ro 

II 

00 

U1 






SADVANCE 


.021 


.04 


.4849 


Adj. R 2 = .82 



* One tailed tests 
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declines some from the full sample, which is to be expected given 
the smaller sample size in the subsamples. 

There is one pattern of interest. For follow-on series 
(Table 8) , coefficients for the ADVANCE predictors are larger than 
for the STAND predictors. (This is generally not the case in Table 
7 for the new design aircraft.) The pattern becomes understandable 
by considering that new designs involve construction from the 
"ground up" of a new aircraft. Both achieving the current SOA 
(STAND) and extending it (ADVANCE) must be "paid for". A new 
series of an existing design, however, involves only "building 
from" an existing aircraft. Cost should then be more strongly 
driven by the extension to the existing aircraft that must be "paid 
for". In short, higher coefficients for ADVANCE for follow-on 
series is a plausible result, and suggests that the ADVANCE and 
STAND measures do meaningfully capture elements of importance in 
explaining the production costs. 



PRODUCTION COST VARIANCES 

Predictions for production cost, given the technology embodied 
in the aircraft, can be created by taking the predicted values from 
the Table 6 regressions (Models 1, 2, and 4) and converting (un- 
logging) to arrive at estimated production cost. Actual costs of 
course differ from the estimated costs. Variances can be 
constructed by subtracting (actual - estimated) , which can be 
interpreted as cost over (under) runs, given the technology produced. 
These cost variance measures are, of course, not measures of cost 
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overruns or underruns in the most traditional sense of being 
measured relative to a budget. Traditional variance measures most 
frequently compare resource inputs (costs) relative to budgeted 
inputs. The variance measures here compare actual costs with 
expected costs based on output, where output is measured by the 
technological performance of the aircraft. Table 9 lists the 
actual costs (COST) , estimated costs (EST) and cost variances (VAR) 
for the various cost categories. 

Plots of the cost variances, arranged by REACH of the flyaway 
aircraft (FREACH) are in Figures 4 through 6. Two aircraft are 
highlighted in the figures, the F/A-18A and the F-14A. Figure 6 
shows a large positive variance (cost overrun) for flyaway aircraft 
cost was incurred on the F/A-18A. Figures 4 and 5 show that the 
F/A-18A also experienced the largest positive variances on airframe 
and platform costs, suggesting that these two cost elements 
contributed greatly to the expensive flyaway cost. Figure 6 shows 
the largest negative variance was experienced on the F-14A; it was 
inexpensive relative to the technology embodied in it. The large 
"savings" was apparently not due to an inexpensive airframe or 
platform; variances in Figures 4 and 5 are close to zero. This 
suggests that the avionics and weapons systems added to the 
platform were cost effective. They enhanced the flyaway 
performance of the aircraft substantially relative to their 
additional cost. 

The variances may be interpreted as measures of cost overruns 
or cost savings, relative to the technology embodied in the 
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TABLE 9 



PRODUCTION COST VARIANCES 



PROGRAM 


FRAMCOST 


FRAMEST 


FRAMVAR 


PLATCOST 


PLATEST 


PLATVAR 


FLYCOST 


FLYEST 


FLYVAR 


A-1E/G/H 


1.212 


1.7455 


-0.5335 


1.557 


2.0889 


-0.5319 


1.703 


1.9417 


-0.2387 


A-3A/8 


5.136 


9.4677 


-4.3317 


6.007 


10.7262 


-4.7192 


7.815 


10.6813 


-2.8663 


A-4C 


1.669 


1.6051 


0.0639 


1.895 


2.0100 


-0.1150 


2.100 


2.2091 


-0.1091 


A-4M 


2.225 


1 . 98 08 


0.2442 


2.927 


2.7128 


0.2142 


3.714 


3.0508 


0.6632 


A-4A/8 


1.603 


2.6529 


-1.0499 


1.859 


3.2692 


-1.4102 


1.917 


2.9393 


-1.0223 


A-4E/F 


1 .875 


1.9690 


-0.0940 


2.436 


2.5112 


-0.0752 


2.675 


2.8342 


-0.1592 


A- 6 A 


11.286 


8.0200 


3.2660 


12.421 


9.7899 


2.6311 


13.123 


10.7900 


2.3330 


A-6E 


7.656 


5.4811 


2.1749 


8.883 


7.0180 


1.8650 


10.846 


11.3311 


-0.4851 


A-7D 


2.950 


4.0890 


-1.1390 


3.847 


5.2537 


-1.4067 


5.012 


7.1770 


-2.1650 


A-7E 


3.901 


4.9069 


-1.0059 


4.855 


6.2291 


-1.3741 


5.000 


9.4962 


-4.4962 


A-7A/8 


3.217 


7.0675 


-3.8505 


4.511 


8.9808 


-4.4698 


5.272 


9.0227 


-3.7507 


A-10A 


4.196 


6.1827 


-1 .9867 


5.748 


8.5826 


-2.8346 


7.272 


8.0499 


-0.7779 


F- 18/C/M 


2.229 


2.1777 


0.0513 


2.297 


2.6973 


-0 .4003 


2.388 


2.9872 


-0.5992 


F-3A/8/C 


3.419 


2.9304 


0.4886 


4.205 


3.5590 


0.6460 


4.710 


4.7552 


-0.0452 


F-4E 


3.649 


3.6452 


0.0038 


4.479 


4.6447 


-0.1657 


5.919 


6.0153 


-0.0963 


F-4J 


3.511 


3.7550 


-0.2440 


4.416 


4.7752 


-0.3592 


5.924 


5.9135 


0.0105 


F-4A/8 


7.202 


5.4733 


1.7287 


8.802 


6.7439 


2.0581 


9.613 


6.7090 


2.9040 


F-4C/D 


. 


. 










5.753 


4.7770 


0.9760 


F-8A/8/C 


3.746 


3.6788 


0.0672 


4.334 


4.5077 


-0.1737 


4.475 


5.0313 


-0.5563 


F-9F/H 


0.655 


1 .8028 


-1.1478 


0.856 


2.2431 


-1.3871 


0.939 


2.4442 


-1.5052 


F-14A 


13.082 


12.8392 


0.2428 


17.333 


16.4507 


0.8823 


23.901 


29.5799 


-5.6789 


F-15A 


10.252 


7 .8038 


2.4482 


15.446 


10.4991 


4.9469 


19.356 


11.4349 


7.9211 


F-16A 


4.045 


6.8782 


-2.8332 


6.069 


9.7101 


-3.6411 


9.641 


10.2310 


-0.5900 


F/A-18A 


18.854 


6.9235 


11.9305 


22.197 


9.8477 


12.3493 


23.968 


16.7833 


7.1847 


F-84F 


6.520 


2.2941 


4.2259 


6.020 


2.6750 


3.3450 


5.943 


2.7068 


3.2362 


F-86D 


0.752 


1.3388 


-0.5868 


1.118 


1.6176 


-0.4996 


1.458 


1.7129 


-0.2549 


F-86F 


0.887 


1.2778 


-0.3908 


1.028 


1.5487 


-0.5207 


1.095 


1.7415 


-0.6465 


F-89D 


2.471 


1.1814 


1.2896 


2.831 


1.4393 


1.3917 


3.496 


1.6884 


1.8076 


F-100D 


1.698 


1.6247 


0.0733 


2.426 


1.9849 


0.4411 


2.659 


2.3624 


0.2966 


F-100A/C 


2.939 


2.0049 


0.9341 


3.709 


2.4968 


1 .2122 


3.856 


2.7333 


1.1227 


F- 1 0 1 A/8 


5.771 


4.8455 


0.9255 


6.735 


.5.7839 


0.9511 


7.291 


8.0596 


-0.7686 


F-102A 


6.802 


3.4071 


3.3949 


8.125 


4.1297 


3.9953 


9.206 


5.3472 


3.8588 


F-104A/8 


2.004 


2.5281 


-0.5241 


3.830 


3.2009 


0.6291 


3.773 


3.6381 


0.1349 


F-1058/D 


10.047 


7.3465 


2.7005 


10.952 


8.7374 


2.2146 


12.280 


10.8976 


1.3824 


F-106A/8 


7.014 


4.7065 


2.3075 


7.897 


5.7648 


2.1322 


12.016 


7.7213 


4.2947 


F-111A 




. 






. 


. 


23.510 


20.5358 


2.9742 


F- 1 1 ID 


. 


, 










24.141 


20.9804 


3.1606 


F-111F 


9 .827 


13.7861 


-3.9591 


14.121 


16.6080 


-2.4870 


20.897 


26.3578 


-5.4608 
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FIGURE 4 



PLOT OF FRAME COST VARIANCE VERSUS FLYAWAY REACH 
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FIGURE 5 
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FIGURE 6 
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systems. The following chapters address the question of possible 
causes of the variances. 
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IV. EXPLAINING VARIANCES 



PROGRAM AND ENVIRONMENT FACTORS 



Clearly defense procurement, particularly for major weapon 
systems, is specialized in nature. Both the product and market are 
not typical of products and markets in general. Major weapon 
systems are large dollar items which may represent a substantial 
segment of a manufacturer's business. Major weapons systems 
incorporate significant innovation with state-of-the-art hardware 
and substantial uncertainty in development. The market for defense 
systems is unusual, with a single (monopsonistic) buyer and usually 
only a few (oligopolistic) sellers. Pricing strategy for such 
items is likely to be an important strategic decision. 

Prices are determined primarily through a bid and negotiation 
process. A bid is accepted and a contract for a specified number 
of units is negotiated prior to production. Prices (costs to the 
government) are specified in the contract and are based on costs 
incurred ("cost plus") using some agreed upon formula. Cost 
estimates and their source are disclosed at the time of contract 
negotiation, so some agreement on the validity of cost estimates 
is established up front. 

When does the government pay "too much" or "too little" for 
high technology systems? Or phrased alternatively, what conditions 
are associated with positive or negative cost variances, given the 
technology embodied in the system? Several factors might 
influence the price that would be offered by the contractor, and 
accepted by the government, and consequently have some impact on 
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program costs. The factors fall into three broad areas: 1) program 
characteristics, 2) the political environment, and 3) the economic 
environment. 

Several variables are discussed below. Each is an attempt to 
reflect some feature of a program or the procurement environment 
existing at the time of program initiation. For each factor, how 
that factor might influence the prices that are offered by 
contractors and accepted by DoD are discussed. To the extent to 
which these factors influence prices paid, they provide possible 
explanations for cost variances experienced. Recall that higher 
(positive) cost variances reflect cost overruns and lower 
(negative) variances reflect cost savings. Additionally, note that 
prices charged by a manufacturer are costs to the government. 

EXPLANATORY VARIABLES 

Program Value . Larger programs may be associated with greater 
risk to a contractor. If a program is "small", experiencing 
unexpected costs or losses on the program, while damaging to a 
firm, would likely not be critical. In contrast, unfavorable 
performance on a "large" program could have significant 
implications for the performance of the firm as a whole. Greater 
down-side financial risk exists. Additionally, larger programs 
may, because of their size and complexity, be more difficult to 
manage and control. Greater managerial risk exists. Consequently, 
it was expected that, as the size of a program (as measured by the 
dollar value of the program to the contractor) increased, 
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